Basics and Foundation - What is video stabilization

>

RidgeRun Video Stabilization Library

Table of Contents [Sticky]

• Basics and Foundation
  • What is Video Stabilization
  • Video Stabilization Process using IMU
  • Stabilization Algorithms with IMU
• Getting Started
  • Supported Platforms, Sensors and Backends
  • Evaluating the Library
  • Getting the Code
  • Building the Library
• API Reference
  • Library Architecture
  • Adding New Sensors
  • Adding Algorithms
  • Adding Stabilization Algorithm
  • Adding Backends
  • API Documentation
  • Examples Guidebook
• Library Integration for IMU
  • Preparing the Video
  • Preparing the IMU Measurements
  • Measurement Integration
  • Interpolation
  • Computing the Stabilization
  • Video Undistortion
  • Example Application
• GStreamer
  • Add Support for Video Timestamps
  • Add Support for IMU Sensors
  • Video Stabilizer Element
  • Example Pipelines
• Useful Links
  • BMI160 Setup
  • Performance
• Contact Us

What is video stabilization?

Video Stabilization

During video capture, the camera is subject to external undesired movements, such as vehicle vibrations, unconscious hand movements, and external forces like wind or the sea. However, it is possible to filter these noisy movements using digital stabilization techniques, which move the image to counter the undesired movement. Video stabilization is a process aimed at reducing these unwanted camera movements to improve the overall viewing experience.

Noisy movement place holder video

This process is especially important in scenarios where videos are shot handheld or in motion, such as with drones, robotics, and professional footage in sports and racing, among others. Outdoor surveillance footage can also be affected by vibrations and wind. Stabilization becomes critical in these cameras to achieve better image quality that helps identify details required to safeguard the surveilled people. The goal is to ensure that the final result is visually appealing and comfortable to watch.

More stable footage can also be beneficial for other tasks, such as video analysis by machine learning algorithms. Stable footage can provide more consistent data for these algorithms to process.

Offline and online video stabilization

Offline Video Stabilization

This process is typically done in post-production using video editing software. Techniques such as optical flow analysis or feature tracking are commonly used, which involve tracking the motion of distinct features in consecutive frames. This motion information is then used to stabilize the video in order to reduce the blurring and shaking caused by camera movements.

Live Video Stabilization

Live stabilization occurs in real-time during the recording of the video. It often involves the use of mechanical devices like gimbals, which physically counteract unwanted camera movements to produce smoother footage. On the other hand live stabilization can also leverage Inertial Measurement Units (IMUs). IMUs provide real-time data at a high frequency about the orientation and rotation of the device. This data can be used to digitally adjust and correct the video frames on-the-fly.

Video stabilization is a vital process in video production, ensuring smooth and professional-grade footage.

>